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What is PISA? 


The Programme for International Student Assessment (PISA) is an important worldwide research 
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PISA is designed to examine how 15-year-olds can apply what they have learned in school to real 


life situations. Pupils are asked to use their skills of reasoning, interpretation and problem solving 
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Each cycle of PISA has a different focus. The main focus in PISA 2018 was reading, but it also 
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Who is NFER? 


The lives of children and young people 

worldwide are inextricably linked to 

the amount and quality of education 

they receive. At NFER, our mission is to 

improve outcomes for future generations 7 E 
everywhere and to support positive change 

across education systems. 


We do this by: 


* creating and sharing research evidence : 
and insights on education policy and : 
practice 


¢ informing policymakers and other key 
decision-makers 


* providing insights, resources and support 
to strengthen practice in the classroom. 


Making a positive impact on children’s and 
young people’s experience of education, 

their outcomes and on teaching and 

learning is at the heart of everything we do. ;: 


In the majority of countries that 
a) participated in PISA, pupils who 
@ saw themselves as competitive 
scored higher in reading than pupils 
who perceived themselves as less 
competitive (OECD, 2019). 
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'Some pupils in Scotland also answered 
questions on global competence. 
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It is important that the PISA results are interpreted 
appropriately, as a simplistic view can be misleading. 
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Comparisons between countries 


Rather than focussing on the rankings of countries, it is 
more important to know whether countries are statistically 
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improved score in a particular subject, but may have fallen 
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Changes over time 


An increase or decrease in score from one cycle to the next 
does not necessarily indicate that national achievement has 
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score is statistically different from previous scores and that 
changes have not arisen solely by chance. Moreover, any 
change in scores may not necessarily be attributed directly 
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understand the full picture. Further analysis is often needed 
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Variations in pupil achievement 


A simple average score does not provide a full picture of 

a particular country. For this reason, PISA also looks at the 
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the differences between the highest and lowest scores and 
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low international benchmarks, known as proficiency levels. 
For example, two countries could have the same overall 
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reaching basic proficiency levels. This would suggest less 
equity across pupils. This kind of evidence can be used to 
identify particular groups of pupils where resources can be 
targeted most effectively. 
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PISA assessments are not curriculum based and use 
different methods from national examinations, as they have 
different goals and outputs. PISA is designed to look at the 
performance of education systems, not of individual pupils. 
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some caution. 
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PISA provides in-depth information about education 
systems, schools and pupils. It explores the relationship 
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evidence-based decisions, using PISA results alongside other 
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@® England 
@ Northern Ireland 


? 
How do the results compare across the UK? @ Scotland 
@ Wales 
Reading eee oe 
scores 501 
OECD average (487) 
483 

Pupils in England, Scotland and Northern Ireland scored 

significantly higher than the average score across the OECD. The 

average score in Wales was similar to the OECD average but 

significantly lower than England, Scotland and Northern Ireland. 
Achievement gap in reading Proportions of low and 
PISA shows some variation in the size of the achievement | high performers in reading 


gap in different countries. In reading, the gap between 
highest and lowest achievers was largest in England and 


smallest in Scotland. 
England 


Lowest (10th percentile) Highest (90th percentile) 


18% Northern 
Ireland 


300 > 700 


Reading trends over time 


Reading in Scotland has improved since 2015 OECD 
while the trend is stable in other parts of the UK. average 
506 505 

Lowest Top performers: 
performers: Pupils reaching 
Below Level 2 Levels 5 and 6 
which is defined in reading are 
by OECD as basic considered to be 
proficiency. ‘top performers’ in 


the global context. 
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*The mean score of that year is was statistically proficiency). 
4 different from the mean score in 2018. 


‘ Pupils in England scored significantly higher 
Science than the other UK nations and the OECD 
scores average for science. Pupils’ scores in Northern 

Ireland, Scotland and Wales were statistically 
similar to each other and to the OECD average. 
507 
491 490 
OECD average 488 
(489) 


Achievement gap in science Proportions of low and 


In science, the gap between highest and lowest achievers | high performers inscience 
was largest in England and smallest in Wales. 


Lowest (10th percentile) Highest (90th percentile) © England © 
+70 I Northern @ 
Ireland 
7 ETRE co; } scotiand & 
300 > 700 } Wales 5%) 
Science trends over time 
OECD 
The trend in science was downwards in Northern Ireland, average 
Wales and Scotland while England has remained stable. 
os 515 =iS Lowest Top performers: 
performers: Pupils reaching 
Below Level 2 Levels 5 and 6 
which is defined in science are 
508 by OECD as basic considered to be 
proficiency. ‘top performers’ in 
505* the global context. 
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495 


*The mean score of that year was statistically 
different from the mean score in 2018. 


scores 


Achievement gap in mathematics 


In mathematics, the gap between highest and lowest 
achievers was largest in Scotland and smallest in Wales. 


Lowest (10th percentile) Highest (90th percentile) 


Mathematics 


The highest attainment for mathematics was in 
England, where scores were significantly higher 
than other UK countries and higher than the 
OECD average. Scotland, Wales and Northern 
Ireland were not significantly different from 
each other or from the OECD average. 


Mathematics trends over time 


England and Wales have improved their maths score 
over time, Scotland has declined and Northern Ireland 


has remained stable. 


506* 


498 


494 


490 
484 


> 700 


OECD average 489 487 


Proportions of low and high 
performers inmathematics 


England 


Northern 8% 
Ireland 


Scotland 


OECD 
average 


Top performers: 


performers: Pupils reaching 
Below Level 2 Levels 5 and 6 in 
which is defined mathematics are 
by OECD as basic considered to be 
proficiency. ‘top performers’ in 


the global context. 
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achieving pupils than across the OECD. 
(Goro) a f=lale Mc swsiiaali tela kod al-m@) = @1D-WV.-1a-le[-) 


2006 2009 2012 2015 


*The mean score of that year was statistically 
different from the mean score in 2018. 


2018 
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How do the results compare across the UK? 


Socio-economic ee ee eee ee re a ere rere ee 
background : In spite of socio-economic disadvantage, some 

> pupils attain high levels of academic proficiency. 
On average, pupils in the UK havea higher : Onaverage across OECD countries, one in ten 


socioeconomic status than the average : disadvantaged pupils was able to score in the top 
across the OECD countries, according to > quarter of reading performance in their countries 

the economic, social and cultural status > (known as academic resilience), indicating that 

(ESCS) index. ESCS is estimated based : disadvantage is not destiny. (OECD 2019) 

on household possessions and parents’ : 
occupation and education. eoceceeoeeree oe eee ee eee eee eee eee eee eee eee eee ese ese sere 


Reading performance of UK countries and OECD by ESCS quartile 


‘More advantaged pupils achieved higher 

The gap between ‘reading scores than their less advantaged 
the most and least ‘peers, and this was true for each quartile. 
disadvantaged : 
pupils was smaller in 

: and 
Northern Ireland 
than across the 
OECD, indicating 
that pupils in those 
countries were more : 
able to overcome + 476 
the effects of : 
socio-economic 
background.* 


539 
534 


The gap was 3 

smallest in ; > 445 

but its more . 

advantaged pupils : Ql Q2 Q3 Q4 


also had lower : < > 
scores than other : 
countries. Me ee cr er re ee re eer Oe et ace reer 
: *The gap between the most and least disadvantaged in England was not significantly 
dub Aled Ge nivah Syd avo anda ave aude aes different from that in OECD overall. 


(most disadvantaged pupils) (least disadvantaged pupils) 
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UK, girls significantly Hrelainterslald hy, boys significantly 
outperformed boys in outperformed boys in olUhu el-lare)aaal-vemellaicwmia 
GENDER reading, as was the case NKoyadal-idamicclclarem olehs =dare|t-jareur-jaremerere) al are| 
r(ol go) a= ©) = 1D id at-laomclacm arene) alhirerslaie but there were no 
gender differences ike] alba kerslaluxe|liieyaclarercss 
in England, Wales or in Wales or Northern 
Scotland. Ireland. 


In all countries and : 
economies, girls we. Ss 
“a 
r) reported much 
greater enjoyment of 
reading than boys. 
(oe) = o4 py Lo) i °)) 


TUT e)| ala =tateltelalemrelare mvc cess 
ins) alo(-o Muon ok-Manvo)a-mexo)aylellaiallal 


their reading ability than pupils 
lalesxere)at-lavemr-larem \(e)auat=\aa) 
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average in OECD countries. 
HABITS However, pupils in Wales, 
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were less likely to read books ge - 
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Wales, Northern Ireland and — 
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attitudes towards reading than 
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part in PISA 2018 cited three 

e@ main aspects of their lives that 
influence how they feel: how 

@ satisfied they are with the way 


Pupils were asked to 
rate how satisfied they 
were with their life as & 


e Waren ds ee (esin uO ) & they look, with their relationships 
which their life has with their parents, and with life 


MUSE lMlnlesele [SULMgIoe at school. (OECD 2019) 
their subjective 


LIFE Meili exeviakemslaremualqvia 
experiences of ; ~ 
SATISFACTION \ Biiving | 
Pupils in all UK { 
countries were less wo 


satisfied with their lives 
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SCHOOL 


RESOURCES 
Headteachers and Is your school’s capacity to 
rey larel| ek-|ismr-\ol ceksom uals mKelel a Pi : : 
nicesunniee soured provide teaching hindered by 
(ollix-Va-\aluma-ssxelUlgellave Mm SS1U[-ce any of the following issues? 
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Nearly half of headteachers in Scotland reported 
that teaching was hindered by a lack of teaching 
staff, compared to just over a quarter in the rest 
of the UK. 


Northern Ireland 


Scotland BES, 


Wales P2:4%4 


In England, less than 20% of headteachers 
reported a lack of support staff as a hindrance, 
compared with 24% in Northern Ireland, 47% in 
Scotland and 33% in Wales. 


OECD average 


Lack of 
teaching staff 


England 
Northern Ireland 
Scotland 

Wales 


OECD average 


Lack of 
support staff 


RK. t A 
e |= — 
7 i N 
RESOURCES 


Headteachers in Wales reported 
greater shortages or inadequacies of @ 
educational materials (e.g. textbooks, © 


Ce ee} 


Teacher enthusiasm and 
@ teachers’ stimulation of 
2) reading engagement were 
the teaching practices most 
strongly (and positively) 


IT equipment etc.) than those in the 
rest of the UK. 


Principals in Northern Ireland associated with pupils’ 
reported more inadequacies with enjoyment of reading. 
the physical infrastructure than (OECD 2019) 


headteachers in the rest of the UK. 
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countries across 
id at-mce)alem Kole) .4 
part in PISA 2018 


SR 


107 schools and 2,969 pupils eTUrey alam =tatel laren 


Wales, Northern 
Ireland and 
SYoro)at-larom at-lem (oN \iel4 
expectations of 
their highest level 
fo} mel UT-)Ihiker-lu(olamuatelal 
rele} e)| sare (ol cession al) 
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170 schools and 5,174 pupils 
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75 schools and 2,360 pupils 


107 schools and 3,165 pupils 


YW 


As with previous cycles 

fo) od syn datum alle] alesis 
rex-laxe)gaaliate mere!’ laludi=ssrm lant] || 
subjects, were East Asian. 


Headteachers in England 

were more likely than 

those in the rest of the UK 

to report that they had F 
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connected to the internet. 
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Wales were more likely to report e™» 
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headteachers and principals in 
state} t-latemr-[avem \ko)aual-idaMiccitslarer 


Pe “3 
pee Principals in Northern 
ee Ireland were least likely to 
Reed ‘ report truancy as a problem 
: while headteachers in 
ah Bp ners ance eres Scotland reported it most. 
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Curriculum 


Northern Ireland 


No academisation or free schools. 
Academic selection is a significant a 
feature of the grammar school aX 
sector, which comprises 34% of + 
post-primary schools. Schools © 
largely organised along community 
background lines. k Og 


e Th 

. a ¢ 2g 
Northern Ireland Curriculum of four 23 
themes, with Key Stages, evolved 
from 1988/1999 Acts, with school  & 
autonomy about how to deliver. © 
Teacher assessment required at rb, “fe 
end of each Key Stage, and one 
set of compulsory testing at 
with several awarding bodi 


Wales 


Community-based comprehensive 
schools, no academisation, free 
schools or selection. Four regional 
consortia of local authorities tasked 
with school improvement. 


National Curriculum and Key Stages 
and exams, evolved from 1988 

Act. Foundation stage and three 
Key Stages. New Curriculum for 
Wales in development. Nine sets of 
compulsory tests (eight National 
Reading and Numeracy Tests 

plus GCSEs, which have several 
awarding bodies). 


and assessment 


Scotland 


Community-based comprehensive 
schools, no academisation, free 
schools or selection. 


Significantly different system from 
the other three countries, the 1988 
Education Reform Act does not 
apply. Curriculum for Excellence 
implemented 2010. Four sets of 
Scottish National Standardised 
Assessments introduced 2017/18. 
No GCSEs or A levels, but National 
ualifications with a single 
warding body. 


England 


An emphasis on parental choice 
and school diversity. Academies 
Cincluding free schools) represent 
32% of primary and 75% of 
secondary schools. Limited 
selection by ability. 


onal Curriculum and Key 
evolved from 1988 
ion Reform Act. Four sets 
| ee tests (phonics and 

1 table checks, two 
Curriculum testing), 
veral awarding 
ity system 
emic subjects. 
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Overview of PISA - who takes part? 
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regions. Education systems differ considerably across countries, including the age at which pupils 
start school and the policies and practices employed. 


Argentina Finland rae Sweden 

: va 3 
Brazil FAPETAE Shee aoene ee Switzerland 
Canada Austria sabia Norway eee 

: 1 ermany 

See pone - Greece polene Turkey Indonesia 
ee Belar J Hungary Portugal Ukraine ise Saudi 

oe ae ieaisna Republic of United Arabia 
Dominican Belgium Ireland Kingdom Japan Singapore 
Benue Bosnia and aly Romania a Jordan Thailand 
Mexico Herzegovina Rosey paccen B-S-J-Z Korea United Arab 
Panama Bulgaria Latvia Federation (Chinay' Lebanon Emirates 
Peru Croatia Kazakhstan Serbia Buc Macao Vietnam 
United States Cyprus Lithuania Slovak Darussalam (China) == 
Uruguay Czech Republic Luxembourg Republic Chinese Taipei Malaysia Australia 
— Denmark Macedonia Slovenia Hong Kong Philippines New 
Morocco Estonia Malta Spain (China) Qatar Zealand 


1 B-S-J-Z (China) refers to the four Chinese provinces that participated (Beijing, Shanghai, Jiangsu and Zhejiang). 
NFER has a long history of involvement in international large scale assessments dating back over fifty years. 
We have delivered PISA to UK schools since 2006. For more information see: www.nfer.ac.uk/pisa/about-pisa. 
The PISA 2018 reports are available at www.nfer.ac.uk/pisa/pisa-national-reports 
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